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Abstract 

Coding schemes for discrete memoryless multicast networks (DM-MN) with rate-limited feedback from the 
receivers and relays to the transmitter are proposed. The schemes improve over the noisy network coding proposed 
by Lim et al. For the single relay channel with relay-transmitter feedback, our coding schemes recover Gabbai 
and Bross’s results, and strictly improve on noisy network coding, distributed decode-forward coding proposed by 
Lim et ai, and all known lower bounds on the achievable rates proposed for the setup without feedback. 

The coding schemes are based on block-Markov coding, superposition coding, sliding-window/backward de¬ 
coding and hybrid relaying strategies. In our Scheme lA, the relays and receivers use compress-forward strategy 
and send the compression indices to the transmitter through the feedback pipes. After obtaining the compression 
indices through feedback, the transmitter sends them together with the source message. Each receiver uses backward 
decoding to jointly decode the source message and all compression indices. Our Scheme IB is similar, except that 
here each relay not only uses compress forward to compress its channel outputs, but also performs partial decode 
forward to decode a common part of source message. Our Scheme 1C allows different relays to decode different 
parts of the source message (in Scheme lA, no relay decodes any part of the source message; in Scheme IB, all 
relays decode the same part of source message), which can achieve higher rates than Scheme lA and Scheme IB. 

Motivated by the feedback coding scheme, we propose a new coding scheme for DM-MN without feedback, 
where the transmitter decodes the compression indices instead of obtaining them directly through feedback. It 
is shown that the scheme still improves noisy network coding and distributed decode-forward coding for some 
channels. 


1. Introduction 

The relay ehannel [HI deseribes a 3-node eommunieation ehannel where the transmitter sends a message 
to the receiver with the assistance of a relay. Cover and El Gamal [|3 proposed two basic coding strategies: 
compress-forward and decode-forward that are based on block-Markov coding. The compress-forward 
strategy has the relay compress its outputs and send the compression index to the receiver. The decode¬ 
forward strategy has the relay first decode all or part of the message and then send the decoded message 
to the receiver. Both strategies have been generalized to multiple-relay channels in [|3l, [|4||, [O, 0, 
na. The compress-forward strategy was later extended to multi-message multicast and multi-messages 
networks, the so called noisy network coding (NNC) [j8||, BUl. Recently, a distributed decode-forward 
coding (DDF) scheme was proposed for multicast lITOll and broadcast relay networks ifTTI . which uses 
the partial decode-forward strategy at the relays and backward encoding at the transmitter. For iV-node 
Gaussian relay networks, both NNC and DDF achieve within constant gap from the capacity. 

Decode-forward and compress-forward require sophisticated operations. A much simpler strategy, called 
amplify-forward, was introduced by Schein and Gallager ifT^ for the 4-node Gaussian diamond network. 
When using amplify-forward, the relay scales its received signal and forwards it to the receiver. The 
amplify-forward stragegy was generalized to multihop relay networks in [[T3ll . IIT4l . IfTSlI . A hybrid coding 
scheme that unifies both amplify-forward and NNC for general noisy relay networks was proposed in 

m. 

A different line of works concentrated on the relay channel with feedback [|3, [|T71 . In [O it was 
shown that perfect feedback from the receiver to the relay makes the relay channel physically degraded, 
and therefore decode-forward achieves capacity. For the case of feedback from the receiver or relay to 
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the transmitter, the eapaeity is unknown in general. In [fTTl Gabbai and Bross studied this problem and 
proposed inner bounds by using restrieted deeoding and deterministie partitioning IfT^ . It was shown 
that feedbaek ean strietly improve the no-feedbaek inner bounds aehieved by the eompress-forward and 
deeode-forward strategies for some relay ehannel, for example, the general Gaussian relay ehannel and 
Z relay ehannel. 

In this paper, we eonsider the general diserete memoryless multieast network (DM-MN) with feedbaek. 
This network eonsists of iV > 3 nodes where the transmitter sends a souree message to different reeeivers 
with the assistanee of multiple relays, and eaeh reeeiver or relay ean send feedbaek signals through 
a noiseless but rate-limited feedbaek pipe to the transmitter. We propose new eoding sehemes based 
on bloek-Markov eoding, superposition eoding, sliding-window/baekward deeoding and hybrid relaying 
strategies. Speeifieally, in our Seheme lA, the relays and reeeivers use eompress-forward strategy and send 
the eompression indiees to the transmitter through the feedbaek pipes. After obtaining the eompression 
indiees through feedbaek, the transmitter sends them together with the souree message. Eaeh reeeiver uses 
baekward deeoding to jointly deeode the souree message and all eompression indiees. Our Seheme IB 
is similar, exeept that here eaeh relay not only uses eompress forward to eompress its ehannel outputs, 
but also performs partial deeode forward to deeode a eommon part of souree message. Our Seheme 1C 
allows different relays to deeode different parts of the souree message (in Seheme lA, no relay deeodes 
any part of the souree message; in Seheme IB, all relays deeode the same part of souree message), whieh 
ean aehieve higher rates than Seheme lA and Seheme IB. 

Our eoding sehemes (Seheme lA-lC) are reminiseent of the NNC seheme for general networks 
[ISl, DU in the sense that the relays and reeeivers eompress their ehannel outputs and broadeast the 
eompression messages. However, we introduee eombined eompress-forward and partial deeode-forward 
strategy into the relay networks. Moreover, our sehemes have the transmitter/orwarJ the reeeivers’ and 
relays’ eompression messages, instead of ereating a new eompression message. This is similar to the 
sehemes proposed in [fT^ for the broadeast ehannel with feedbaek, where the transmitter forwards the 
reeeivers’ eompression messages. Finally, sinee the transmitter knows the souree message and ean obtain 
the eompression messages through feedbaek, we are able to superpose the transmitter’s input on the 
reeeivers’ and relays’ inputs, establishing eooperation between the transmitter and the reeeivers&relays. 
It is shown that our eoding sehemes generalize Gabbai and Bross’s results [fTTIl for the relay ehannel 
with relay-transmitter feedbaek. For some ehannels, sueh as the Gaussian relay ehannel and Z relay 
ehannels, our eoding sehemes strietly improve over the NNC, the DDF, and all known lower bounds on 
the aehievable rate in the absenee of feedbaek. 

Motivated by our feedbaek eoding sehemes, we propose a new seheme for DM-MN without feedbaek. 
The key idea is that in eaeh bloek, instead of obtaining eompression messages direetly through the 
feedbaek pipes, the transmitter decodes the eompression messages based on its observed ehannel outputs. 
Note that in absenee of feedbaek, the transmitter’s input eannot be superposed on the reeeivers’ and 
relays’ inputs like the feedbaek ease. This is beeause at the beginning of eaeh bloek 6 G [1 : 5], the 
transmitter ean only reeover the relays’ and reeeivers’ inputs of bloek 6 — 1. To ensure the eooperation 
between the transmitter and the reeeiver&relays, in eaeh bloek 6, we let the relays and reeeivers resends 
some messages that were sent in bloek 6 — 1, whieh introduees dependenee between the inputs of the 
transmitter and reeeivers&relays. It is shown that our non-feedbaek eoding seheme strietly improves the 
NNC and DDF lower bound for some ehannels. 

This paper is organized as follows. Seetion II deseribes the system model: multieast networks with and 
without feedbaek. Seetion III gives our main results and Seetion IV presents three examples eomparing 
our lower bounds with known lower bounds. Seetion V eontains the proofs of Theorems 0 0 and ig 
Finally, Seetions VI gives the proof of Theorem 

Notation: We use eapital letters to denote random variables and small letters for their realizations, e.g. 
X and X. For nonnegative integers fc, j, let Xl := (X^,... ,Xj) and := {xk,i, ■ ■ ■ ,Xk,j). 

For a set of integers ^ C [1 : X], we denote by |^| its eardinality and its eomplement by := [1 : 
X]\^. A tuple of random variables is denoted as X(^) := [X^ : k e A]. 
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Given a distribution Pa over some alphabet A, a positive real number e > 0, and a positive integer n, 
Te"‘\PA) is the typieal set in [l20l . Given a positive integer n, let 1[„] denote the all-one tuple of length 
n, e.g. 1[3] = (1,1,1). Define a funetion C{x) ;= ^ log 2 (l -f x). 

II. System model 

A. Discrete memoryless multicast networks 

Consider an A^-node DM-MN, see Fig. Let Node 1 be the transmitter, and TZ and V denotes the set 
of relays and reeeivers, respeetively, where 7^ C [2 : iV] and V = [2 : N]\IZ. This setup is eharaeterized 
by 2N finite alphabets Xi,... .. ,yN and a ehannel law PY^-Yj,\x^,...,Xt,{yi, • • •, I/tvIti, ..., xn), 

where input Xj G Xj and output yj G yj, for j G [1 : N]. At diserete-time i G [1 : n]. Node j G [1 : N] 
sends input Xj^i G Xj and observes yjj G yj, where n denotes the total bloeklength used in the transmission. 



M(d) 


Fig. 1. A^-node discrete memoryless multicast network 


The transmitter eommunieates a message m G [1 : 2”^] to the set of reeeivers V with the assistanee of 
relays TZ. A (2”^, n) eode for this ehannel has 

• a message set [1 : 2”-^], 

• a souree eneoder that maps (M, 17“^) to the ehannel input 17”^), for eaeh time i E [1 : n], 

• relay and reeeiver eneoders that maps 17”^ to a sequenee for eaeh fc G [2 : A^] and 

i G [1 : n], 

• deeoders that estimates based on Yy, for d E V. 

Suppose m is uniformly distributed over the message set. A rate R is ealled aehievable if for every 
bloeklength n, there exists a (2"^, n) eode sueh that the average probability of error 

pi^) = ^ M, for some dEV] 

tends to 0 as the n tends to infinity. The eapaeity GNoPb is the supremum of the set of aehievable rates R 
sueh that lim„^oo Pe'^'’ = 0. 

B. Discrete memoryless multicast networks with feedback 



mW 


Fig. 2. A^-node discrete memoryless multicast network with feedback 


Consider an A^-node DM-MN with feedback, see Fig. This model ean be modified from the model 
without feedbaek in Seetion II-A if in the later setup Yi j represents the feedbaek signals sent by the 
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receivers and relays, i.e., Yi^i = {F 2 ^i,... j-Fat,*), where Fk,i G Fk,i is the feedback signal sent by Node 
/c G [2 : N], and Fk,i denotes feedback finite alphabets. 

More specifically, after observing Yk^i, each Node A; G [2 : iV] produces the channel input Xk^i and 
feedback signal Fk^i based on (Yk^i,... ,Yk^i-i), then it broadcasts Xk,i into the network and sends Fk^i 
to the transmitter through a feedback pipe. Let denote the capacity in the presence of feedback. 

Suppose the feedback pipe between the transmitter and Node k is instant, noiseless and rate-limited to 
i?Fb,fc bits per channel use, then 

X ■ ■ ■ X \Fk,n\ < fc G [2 : N]. (1) 

When i?Fb,k > log 2 the network is equivalent to perfect-feedback setup where after each channel 
use the receivers and relays send their channel outputs back to the transmitter, i.e., Yi = (I 2 , • ■ ■, Y^). 

III. Previous lower bounds and motivations 

We recall some previous lower bounds on the capacity of DM-MN and present interesting observations 
that inspire our work. 


A. NNC and DDF lower bounds 

The NNC was proposed by Lim et al. (U, where each Node fc G [1 : iV] compresses its received signal 
Yk to Yk and broadcast the compression message into the network. For DM-MN, the NNC leads to the 
lower bound which satisfies 


R<I{X{S);Y{S^),YfX{S^)) 

-/(y(5);K(S)|Xf,yj,y(5')) (2a) 


for all d G D, 5 C [1 : N] with S fl {1} 7 ^ 0, 5'^ flD 7 ^ 0 and for some pmf 


N 




YkXkYk 


.k=l 


F 




( 2 b) 


The DDF was proposed by Lim et al. ifT^ . where the transmitter uses backward encoding to generate 
auxiliary indices that control the transmission over the entire network. For DM multicast network, the 
DDF lower bound satisfies 


R<I{X{Sy,U{S^),YfX{S^)) 

-J2HUk,U{S^,),X^\Xk,Yk) (3) 


for all d G D, iS C [1 : N] with 5n{l} 7^ 0, S^DV 7^ 0 and for some pmf 
where 5^ = n [1 : fc — 1] for /c G [1 : A^]. 


fN 


11^=2 


Px. 


PxiixfPyfixf Puf\xf’ 


B. Motivation 

Given the NNC lower bound Q, rewrite the right term of ( |2a| ): 

J(X(5); - /(y(5); Y{S)\X^, Y,, Y{S^)) 

= j(Xi,x(r);F(n,y,|x(n) 

-/(T), y (T); Fl, Y{T) |Xf, F,, F(n) 

/(Xi,X(r); F(r^),F,|X(n) -/(Fi; Fi|Xf, F,, 
-/(F(r);F(r)|Xi^,F,,F(n) 

<^(Xi,X(r);F(n,F,|X(r'=)) 

-/(F(r);F(r)|Xf,F,,F(n) 


( 4 ) 
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where T = ‘5\{1} and is the eomplement of T in [2 : N]. The equality (a) holds beeause (X([l : 
A^]\{fc}), V"([l : — i^k, Yk) — Yk forms Markov ehain in view of pmf pb] ), for all k G |1 : N], 

From the inequality (6) in Q, it’s easy to eheek that the optimal ehoiee of Yi is Yi = 0, whieh makes 
NNC lower bound equivalent to 

i?</(Xi,x(r);y(n,F,|x(n) 

- /(r(T);i'(r)|xf,ij,r(r')) (5) 


for dX\ d E V, T C [2 : N] with fl "D 7 ^ 0 and for some pmf 


Ul^Px, 


R 




n 


N p 

k=2^Yk\X,,Yk 


Reeall that in NNC the auxiliary random variable Yi represents the eompression of Yi at the transmitter. 
Setting Yi = 0 means that the transmitter doesn’t eompress Yi, and simply ignores it. 

Now eonsider the DDF seheme. Due to the baekward eneoding at the transmitter, the transmitter has 
to perform eneoding offline before reeeiving Yi, whieh makes it impossible to ultilize Yi. 

To summarize, both NNC and DDF fail to use the transmitter’s observation Yi (In NNC seheme, 
although the transmitter ean proeess Yi, the optimal ehoiee is not to use it.). In faet, Yi is potentially 
useful to improve the aehievable rate and thus should not be simply ignored. In this paper, we propose 
new bloek-Markov eoding sehemes whieh improve the NNC and DDF lower bounds by using Yi and 
hybrid relaying strategies. The key idea is as follows: 


• Eaeh Node fc G [2 : N] eompresses its ehannel output Y^ to Y^, and deeodes (part of) the souree 
message. Then it sends the ehannel input eonsisting of the eompression message and the deeoded 
souree message. 

• The transmitter obtains or deeode^ the eompression messages generated by all the reeeivers and 
relays, based on Yi, and then forwards them together with the souree message. 

• Eaeh Reeeiver k deeodes all eompression messages exeept the one it generated itself, and then 
reeonstruets (Y 2 , ■ ■ ■, Y^). Einally it uses (Y^, Y 2 , ■ ■ ■, Yat) as enhaneed outputs to deeode the souree 
message. 


IV. Main Results 


This seetion presents our main results. The proofs are given in Seetions VI and VII 


A. DM-MN with rate-limited feedback 

Theorem 1. For DM-MN with feedback from the receivers and relays to the transmitter, any rate i? > 0 
is achievable if it satisfies 


J(Xi,X(r);Y(n,Y,|X(n) 

-/(Y(r);Y(r)|Xf^,Y,,Y(n) 

for all d eV and T C [2 : X] with T'^ ft D 7 ^ 0, and for some pmf 

N 1 r ^ 


.k=2 


YklXkYk 


.k=2 


Xr\XfJPYf\X^ 


such that 


( 6 ) 

(7) 


Rvh,k Y I{Yk', Yk\Xk), for k & [2 : X], 


( 8 ) 


where is the complement of T in [2 : X]. 


'when Yi represents the feedback signals sent by the receivers and relays, the transmitter directly obtains compression messages through 
feedback pipes; when Yi represents the channel output instead of feedback signals, the transmitter decodes the compression message based 
on Yi with side information Xi. 
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Proof: See Seetion VI-A 


Remark 1. Comparing the lower bound in Theorem with the NNC lower bound our rate stirctly 
includes NNC if the feedback rates are sufficient large, i.e., if @ holds for all pmfs Q. This is because 
in O we allow the joint input distribution of form Wt^PxrxAxS instead of which attains 

cooperation between the transmitter and the relays&receivers. 


In the seheme for Theorem the relays and reeeivers both perform eompress-forward. In faet, the 
relays ean apply a hybrid strategy that eombines eompress-forward and partial deeode-forward, whieh 
leads to a larger aehievable rate below. 


Theorem 2. For DM-MN with feedback from the receivers and relays to the transmitter,any rate R> 0 
is achievable if it satisfies 


R < /(Xi, X{T), UiTfi Y{T^), YfiXiT^), U{T^)) 
-i{Y{ry, Yiryuy^, xf, y(n, y,) 

+ min I {Ur; Yr\Xr) 

rCiR- 

R < /(Xi, X(r U 7^), U{n); Y{T^ n V), Yd\X{r‘^ n V)) 
-I{Y{T U 7^); Y{T U , Xf, Y{T^ n V), Y^) 


(9a) 


(9b) 


for all d eV and T C [2 : X] with T'^ fTP 7 ^ 0, and for some pmf 


PXrUrP^ 


Yr\UrXrYr 


re'll 


IlPx,P, 


YalXaYa 


Idev 

^ Pxi ixfui'H) Py-F I xf 


such that 


( 10 ) 


RFb,r > I{Yr;Yr\Xr,Ur), for r G TZ (Ha) 

RFb,d > k{Yci;Yd\Xd), fordGV. (Hb) 


where Ud = ih for all d eT> and is the complement ofT in [2 : X]. 


Proof: See Seetion VI-C 


Remark 2. By setting Ur = 0, for all r &TZ, the achievable rate in Theorem specializes to the lower 
bound in Theorem 1. Note that setting Ur = ^ for all r ^ IZ means that all relay nodes perform only 
compress-forward strategy without partially decode-forwarding the source message. 


In the seheme for Theorem all relays deeode the same part of the souree message, whieh may lead 
to relatively poor rate performanee when some relay’s observed signal is bad. One improvement eould 
be made by allowing different relays to deeode different parts of the souree message aeeording to the 
strength of their reeeived signals. By doing this way, we obtain the following aehievable rate. 


Theorem 3. For DM-MN with feedback from the receivers and relays to the transmitter, any rate i? > 0 
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is achievable if it satisfies 

R < (Xi,x(r), u{rfiY{r^), r.m,f/o,x(n,f/(n) 

+ V/(t/,;F,|f/o,K),X,)+minJ(t/o;y,|\/o,X,) 

^ rG7< 

rGT'=n7^ 

-/(F(r); F(r)lK), Uo. t/f, xf, X(n, X,) 

< /(Xo, f/o, Xi, X(r U 7^), t/(7^); X(r" n V), Yfi 

x(r"nr>)) 

-/(X(r U 7^); X(r U 7^)|Xo, f/o, f/s"^, 

xf,y(r‘=ni)),Xrf) 

/or all d eV and T C [2 : X] wM T'^ fl "D /: 0, and for some pmf 


such that 


PvoPuo\Vq 


PXr\VoPUr\VoUoXrP%\VQUoUrXrYr 

rCiTl 


X 


-den 


-Pxi|yoC/oX/!7(7e)-Py/|x/ 


(12a) 


(12b) 


(13) 


-Rpb.r > -f(X; f/o) 3/r, f/r), far r E TZ 

RFb,d > I {Yd, Yd\Xd), for deV 

where Ud = ih for all d eV and is the complement ofT in [2 : X]. 


(14a) 

(14b) 


Proof: See Seetion VI-C 


Remark 3. By letting Vq = Uq = 0, we find that the constraint (|12a|) is less stringent than (|^; (|12b|), 
(Q and d reduce to and respectively. Thus the rate in Theorem^includes the rate in 

Theorem |2] 


B. DM-MN without feedback 

Remark 4. The lower bounds present above can be directly extended to DM-MN without feedback by 
letting feedback rate = 0, and 1/ = 0 for all fc G [2 : X]. 

In this subseetion, we propose a new lower bound for DM-MN without feedbaek that makes use of the 
ehannel outputs (not feedbaek signals) observed at the transmitter. The key idea is that the transmitter, 
instead of obtaining eompression messages through feedbaek, decodes them based on its observed ehannel 
outputs. The new aehievable rate is shown below. 

Theorem 4. For DM-MN without feedback, any rate R> Q is achievable if it satisfies 

R < j(Xi,x(r), f/(r), v{ry, Y{r'^), x/ 

U{Ty,V{T^),X{T^)) 

-i{Y{ry, Yiryuy^, vf, xf, x(r^), x,) 

+ mmI{Ur;%\Xr,Vr) (15a) 

R < /(Xi, V{T U 7^), U{n),X{T U 7^); X(r" n V),Yd\ 

V{T^),X{T^nV)) 

-I{Y{T U 7^); X(r U 7^)|X2^, X^, U^, Y{T'^ n V), Yd) 


(15b) 










for all d and T C [2 : iV] with T'^ ft "D 7 ^ 0, and for some pmf 


■ N 



PVkPxk\VuPUk\Vu 


Y\.^Yr\UrVrXrYr 

.k=2 


rER. 


X 


WPYi\ViXaYi 


Pxi I VfUiTl) ^YflXf 


such that 


(16) 


Ht-,Yr\Ur,Vr,Xr)+ 

rsT n 7 ^ deT nv 

< /(X(r); YfU^, X(n, Xi) ( 17 ) 


where Ud = 0, /or a// d &T>, and T'^ w complement off in [2 : X]. 

Proof: See Section m ■ 

Remark 5. The scheme for Theorem requires the transmitter to decode the compression messages 
generated by all receivers and relays, which may limit the performance if there are weak links from the 
receivers or relays to the transmitter. One proper way to improve the scheme is to allow the transmitter 
to adaptively decode a set of (not all) nodes’ compression messages. 

Suppose the transmitter decodes only the compression messages generated by the set of nodes A C 
[2 : X]. Then by a scheme similar to that for Theorem^ we obtain a new lower bound having same rate 
espression as 10 , but is maximized over all set ^ C [2 : X] for all d E V, T C [2 : X] with T^^nV f 
and for some pmf 


■ N 



n PVkPxu\VuPuu\Vu 


WPfrWrVrXrYr 

.k=2 


rCZR. 


X 


WPYi\ViXaYi 

.d&V 


PYf\XfPxi\V(A)U(A) 


(18) 


such that 


I{t-,Yr\Ur,Vr,Xr)+ /(X,; X/K,, Xrf) 

reTAl^Tt- deTAC\'D 

< i{x{rAy,Yfu{A),v{A),x{rx),x,) (i9) 

where Ud = ^ for all d eV,T^ is the complement ofT in [2 : X], T_a = ThA, and Tf is the complement 
of Ta in A 

This lower bound reduces to the lower bound in Theorem^when A= [2 : X], and to the NNC lower 
bound when ^ = 0 and Vk = Uk = 0, for all k E [2 : X]. 


V. Examples 

A. The relay channel with relay-transmitter feedback 

Consider the relay ehannel PY 2 Y 3 \XiX 2 {y 2 ,y'i\xi, xf) with perfeet feedbaek from the relay to the trans¬ 
mitter, see Fig. 

Let X 3 = 0, then lower bound in Theorem speeializes to 

7?</(Xi;X2,X3|X2) 

R < /(Xi, X 2 ; X 3 ) - /(X 2 ; X 2 IX 1 , X 2 , X 3 ) 

for some pmf 1 x 2 X 2 - 


(20a) 

(20b) 
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Fig. 3. Relay channel with relay-transmitter feedback 


Let U 3 = Y 3 = fj), then Theorem specializes to 

R < /(Xi; F 2 , Y3\U2, X 2 ) + I{U 2 -, 

R < /(Xi, X 2 ; F 3 ) - 1{%; Y 2 \U 2 , Xi, X 2 , Xa) 


( 21 a) 

(21b) 


for some pmf Px,x 2 U 2 Py 2 \X 2 U 2 Y 2 - 

In lITTI Gabbai and Bross studied this channel and proposed coding schemes based on restricted decoding 
and deterministic partitioning. The rates p0| ) and pT] ) recover Gabbai and Bross’s rates of Theorems 2 
and 3 in ifTTll . respectively. 

By using NNC [HI, the rate R satisfying 


R<I{XyY2,Y3\X2) 

R </(Xi, X 2 ; X 3 )-/(X 2 ; X 2 IX 1 , X 2 , X3) 


( 22 a) 

( 22 b) 


is achievable for any pmf Pxj^Px 2 Py 2 \X 2 Y 2 ^ which coincides with the compress-forward lower bound (H 
Theorem 6 ]. 

By using DDF [fTOll . [fTTll . the rate R satisfying 


R<I{Xi,X2;Y3) 

R < /(f/2; X2IX2) + /(Xi; X 3 | 2 f 2 , U2) 


(23a) 

(23b) 


is achievable for any pmf Px^X 2 U 2 ^ which coincides with the partial decode-forward lower bound (21 
Theorem 7]. 

The lower bound pOj ) includes ( |22| ) because it allows a joint input distribution PxiX 2 rather than PxiPx 2 - 


The lower bound pTj ) includes ( | 22 | ) and ( |23| ), which can be seen by letting f /2 = 0 and X 2 = 0> respectively. 
In (TTlI Gabbai and Bross showed that for the Gaussian and Z relay channels, the lower bound pTj ) strictly 
improves on the known lower bounds on the achievable rate in the absence of feedback, including the 
compress-forward lower bound in (22] ), and the partial decode-forward lower bound in ( |23] ). In view of 
this fact, we have the following corollary: 

Corollary 1. For the DM single-relay channel with relay-transmitter feedback, our coding scheme recovers 
Gabbai and Bross’s results, and can strictly improve on NNC /H]/, DDF lUW and all known lower bounds 
on the achievable rate in the absence of feedback. 


B. Enhanced Gaussian relay channel 

Consider an enhanced Gaussian relay channel where the transmitter can access the output Xi, see Fig. 
1^ The channel outputs are: 

Xi = g2iX2 + Zi, 

X2 = gi 2 Xi -f Z2, 

Y3 = gi^Xi + g2‘iX2 + Z3 
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Fig. 4. The enhanced Gaussian relay channel 


where g 2 i, 923 , gu and gis are ehannel gains and Zi ~ A/'( 0 , 1 ), Z 2 ~ A/'( 0 , 1 ) and Z^ ~ A/^( 0 , 1 ) are 
independent Gaussian noise variables. The input power eonstraints are IE|X^| < Pi and IE|X|| < P 2 . Let 
S 12 = si 3 = gf^Pi, S 23 = glsP^ and S 21 = 5 ' 2 i^ 2 - 

We eompare the lower bound in Theorem with the eut-set outer bound and the previous known lower 
bounds, sueh as amplify-forward, NNC, DDF and Cover-El Gama’s general lower bound E Theorem 7]. 
Achievable rate in Theorem 1^ Let P 3 = 1/3 = F 3 = 0, then Theorem 0 reduees to 


R < /(Xi;F2 ,>3|^2,C2,X2) +/(P 2 ;> 2 |C 2 ,X 2 ) (24a) 

R < /(Xi, X 2 ; X 3 ) - /(X 2 ; Y2\U2, V 2 , Xi, X 2 , ^ 3 ) (24b) 

for some pmf Py^ | V 2 | 1 ^ 21 / 2 ^ 121 X 2 V 2 c /2 Va sueh that 

/(X 2 ;y 2 |t^ 2 ,L 2 ,X 2 ) < /(X 2 ;yi|P 2 ,Xi,l/ 2 ). (24e) 

To eompute we ehoose the same distributions as in OTll : 

P2 = al/2 + VFo,X2 = cl/2 + VF2 

Xi = bU 2 + Wi, ¥2 = ¥2 + z' (25) 


where V 2 ~ Ar(0,Pi),lLo ~ ^^(0, ^),lLi ~ Ar(0, aPi), IL 2 ~ Ar( 0 , 7 P 2 ) and Z' ~ A^(0,X') are 
independent, for a,f3,'y G [0,1]. For this ehoiee, we have, 

/(.Yii y, lal.Y,. \4, t/j) = C(asa + 

/(y;F2|V'2,A'2) = c(^l/Xl 
VQ!Si 2 + 12 

/(Xi,X 2 ; Y 3 ) = C(^2\J~^^^Si3^3 + Si3 + S23^ 

/(X2;X2|f/2y2,Xi,X2,X3) = c(^), (26) 

and 

/(Vi; y2|c/2, y, A' 2 ) = c(Lt^) 

/(A2;y,|f/2,Ai,y) =C(7S2 i). (27) 


Thus we obtain the lower bound 

R <min |c ^asi 3 + 


q;si 2 


+ 


c( 


Si2l3a 


l + N'J Vasi 2 + 1/’ 


C {2\J a/?7Sl3S23 + Sl3 + S 23 ) 


VX'7 


subjeet to the eonstraint 


N' > 


1 + q;Si 2 


(28) 


7 S 21 


(29) 
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Amplify-forward: For the general Gaussian relay ehannel with linear relaying funetions, finding the ehannel 
eapaeity is a non-eonvex optimization problem for bloeklength n > 2, whieh is almost intraetable. The 
paper Ii22l proposed an aehievable rate: 


R < max -C f 2aP 

0 <a<l 2 \ 


1 + 


IVG 


1 + 5'23'^^ 




where d = y/ 2 P 2 /{ 2 asj^ + 1 ). 

NNC: When using NNC (H, the aehievable rate is: 

R < I{Xp, F 3 IX 2 ) - /(Fi; Fi|Xi, X 2 , F 2 , F 3 ), 

R < /(Xi, X 2 ; Ys)-I{Y2- Y2\X2,Y3)-I{Yi, Fi|Xi,X2, F 3 ) 

for some pmf Px^Px 2 Py 2 \X 2 Y 2 ^Y\XiYi- cheek that the optimal ehoiee of Yi is Fi = 0 , whieh 

leads to the eompress-forward lower bound ( [22| ). The optimal distribution of F 2 is generally unknown. 
Choose y 2 = F 2 + Z' where Z' ~ N'{0, a^) and optimise over We obtain the aehievable rate 


R < C( S13-I 


S 12 S 23 




, ,• (30) 

S13+S12+S23 + I3 

DDF: When using DDF [fTOl . the aehievable rate is same as the partial deeode-forward lower bound ( [23l ). 
For the Gaussian relay ehannels, partial deeode-forward eoding doesn’t improve the deeode-forward lower 
bound [l 22 ll . thus we obtain the aehievable rate 


R < min {C(si3-l-S23-l-2py^s))^^), C(si 2 (l—p^)) } (31) 

for 0 < p < 1 . 

Cover-El Gamal’s general lower bound l\2\ Theorem 7]: In [|2l Cover and El Gamal proposed a general 
lower bound for the relay ehannel by eombining eompress-forward and deeode-forward, whieh ean be 
written as: 


R < I{Xp,Y2,Y3\X2,U2) + I{U 2 -,Y 2 \V 2 ,X 2 ) (32a) 

R < /(Xi, X 2 ; F 3 ) - !{%■, Y2\U2, Xi, X 2 , ^ 3 ) (32b) 

for some pmf Pv 2 Px 2 \V 2 Pu 2 \V 2 Pxi\U 2 Py 2 \X 2 U 2 Y 2 ^^ch that 

I{Y 2 -,Y 2 \U 2 ,X,,X 2 ,Y,) < I{X2-,Y3\V2). (32e) 


Choosing the same distributions as in [|2T]| . we obtain the lower bound with same expression as 
but subjeet to the eonstraint 

(/) — q;/ 3 -f- tt)si3 -f 1 


X' > (a(si 3 -f S23) + !)■ 


Comparing (29) with (33), if 


1 -f o;si 2 


S2i(a(si3 + S 23 ) + 1) 


< 


7S23(ttSi3 -f 1 ) 

(/) — tt/) -f tt)si 3 -f 1 
S23(aSi3 -f 1 ) 


(33) 


(34) 


for all a,/? e [0,1] (e.g. S 21 > S 23 ,Si 2 < S 13 ), our eoding seheme always improves Cover-El Gama’s 
general lower bound (21 Theorem 7]. This general lower bound ineludes both the partial deeode-forward 
and eompress-forward lower bounds O, thus we have the following eorollary: 


Corollary 2. For the enhanced Gaussian relay channel which satisfies ( [34| ), our coding scheme improves 
the known inner bounds, including the NNC and DDF lower bounds and Cover-El Gama’s general lower 
bound /m Theorem 7]. 
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Fig. 5. Achievable rates for the enhanced Gaussian relay channel with yi2 = <713 = <721 = 1 , 523 = 0.7, and Pi = P2 = P 

TABLE I 

Achievable rates for the enhanced Gaussian relay with and without feedback 


d 

Rnnc 

Rddf 

Rce 

7 ?Prol 

Reio2 

0.73 

1.6908 

1.6881 

1.6927 

1.7069 

1.6996 

0.74 

1.6971 

1.6703 

1.6971 

1.7111 

1.7032 

0.75 

1.7033 

1.6529 

1.7033 

1.7153 

1.7077 

0.76 

1.7094 

1.6358 

1.7094 

1.7195 

1.7129 


Based on ( [28| - f33| ), the aehievable rates for gi2 = = g2i = 1, (723 = 0.7, and Pi = P2 = P are shown 

in Fig. 0 

Table^ eompares aehievable rates for this enhaneed Gaussian relay ehannel for gu = l/d,gis = 1, 
923 = 921 = 1/|1 - d\, and with Pi = 5, P2 = 1 - Here Pnnc, -Rddf, Rce, Rpvoi and Ppro 2 denote rates 
aehieved by NNC, DDF, rates from ^ Theorem 7] and rates from our proposed Theorem and 
respeetively. The feedbaek seheme (Pproi) obtains the best performanee, and our non-feedbaek seheme 
for Theorem (Ppro 2 ) strietly improves the known lower bounds in the absenee of feedbaek. 


C. 4-Node Discrete Memoryless Diamond Network 

Consider the 4-node DM diamond network PY 2 Y 3 \Xi{y 2 , y3\xi)PY4\X2X3{y4\x2, xs) iTT^ . From Theorem 
1^ we have 

Corollary 3. For 4-node DM diamond network with relay-transmitter feedback, any rate R > ^ is 
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achievable if it satisfies 

R<I{X,,X2,X,-Y,) 

-I{%, Fs; F3IF0, Uo, f/2, t/3, Xi, X2, X3, Ft) 

R < /(Xi, X2, U2; F3, F4IF0, f/o, X3, f/3) 

+I{Us;Ys\Vo,Uo,Xs)+ min /([/q; F,|Fo, X,) 

re{2,3} 

-J(F2; F2IF0, Uo, U2, Us, Xi, X2, X3, F3, F4) 

R < /(Xi, X2, Us; %, F4IF0, f/o, X2, f/2) 

+/(f/2;F2|Fo,f/o,X2)+ min /(f/o; F,|Fo, X,) 

re{2,3} 

-J(F3; F3IF0, f/o, f/2, f/3, Xi, X2, X3, F2, F4) 

/f</(Xi,X2,f/2,f/3;F4 |Fo,f/o)+ min J(f/o; F,|Fo, X,) 

re{2,3} 

-J(F2, F3; F2, F3IF0, f/o, f/2, f/3, Xi, X2, X3, Ft) 

/? < /(Xi; F2, Fj, FtlFo, f/o, X2, X3, f/2, f/3) 

+/(f/2; F2|f/o, Fo, X2) + /(f/3; F3|f/o, F, X3) 

+ min I{Uo;Yr\Vo,Xr) 

re{2,3} 


(35a) 


(35b) 


(35c) 


(35d) 


for some pmf PtJoVo-PxilVbC/oXaXgt/aC/a nre{2,3} 


PUr\Vo UoXr Pfr \ Vq Uq UrXrYr 


such that satisfies /fpb.r > -f(F; Fr|Vb, f/o, X^, f/r), for r G {2, 3}. 


From Remark and we know that the rate ( [35] ) strietly ineludes the NNC lower bound if feedbaek 
rate is suffieiently large. Now eonsider the DDF lower bound for this setup, whieh is the rate /f > 0 
satisfying 


/f</(X4,X2,X3;F4) (36a) 

R < /(Xi, X2; Ft, 1X2, f/2) + /(f/2; F2IX2) (36b) 

R < /(Xi, X3; Ft, 1X3, Us) + /(f/3; F3IX3) (36e) 

R < /(Xi; f/2,f/3,F4|X2,X3) - /(f/2;Xi,X3|X2,F2) 

-/(f/ 3 ;Xi,X 2 ,f/ 2 |X 3 ,F 3 ) (36d) 


for some pmf It’s not clear in general whieh of the aehievable rate in 

or ([3^ is larger. 


As mentioned in Remark by letting /fpb.fe = 0 and Y^ = 0 , for all A; G [2 : X] in Theorem we 
obtain a new lower bound for the 4-node diamond network without feedback. This lower bound in essenee 
is achieved by letting the two relays use partial deeode forward to deeode different parts of the souree 
message. 


Corollary 4. For 4 -node DM diamond network PY2Yi\xAy‘i)y^\^i)PYi\X2X:i{yA\x2,Xs), any rate R> D is 
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achievable if it satisfies 


for some pmf 


/2</(Xi,X2,X3;F4) 

R< min I{Uo]YfVo,Xr) + I{U 2 ]Y 2 \Vo,U^,X 2 ) 

re{2,3} 

+I{X^,X2,YfVM,X2,U2) 

R< min IiUo;Yr\Vo,Xr) + IiUs;YfVo,Uo,Xs) 

r-6{2,3} 

+I{X^,X2;YfVo,Uo,X3,U3) 

R< min I(Uo;Yr\Vo,Xr) 

re{2,3} 

+/(Xi,X2,f/2,f/3;r4|\/o,^o) 

R< min I(Uo;YJVo,Xr) 

re{2,3} 

+I{U2-,Y2\Uo,Vo,X 2) + I{U3;YfUo,Vo,X,) 

+/(Xi; F2, V^ 3 , YfVo, t/o, X2, X3, U2, U3) 


PuoVoPxi\VoUoX2X3U2U3 


PXrlVoPUrlVoUoXr 

re{2,3} 


(37a) 

(37b) 

(37c) 

(37d) 

(37e) 

(37f) 


VI. Achievable rates for DM multiple-relay channels with partial feedback 
A. Scheme lA 
Define 


Ifo (( 2 , 6 , ■ ■ ■, (a, ft) 

U := {h,h-, ■ ■ ■, J-Nfi) 


forbe[l-.B + 1]. Let Iq = 1[a-i] and ms+i = 1. 

We present a bloek-Markov eoding seheme where a sequenee of B i.i.d message m?, G [1 : 2”^^], 
6 G [1 : 5] is sent over B + 1 bloeks. In eaeh bloek 6 G [1 : i? + 1]: 

• After obtaining all feedbaek messages lb_i, the transmitter sends inputs ^{mb\\b-i)■ 

• Node fc G [2 : A^] uses compress-forward to compress its observed outputs and then forwards the 
eompression message lk,b through feedbaek pipe and sends the ehannel inputs x]^jj_^_flk^b) in bloek 
6 + 1 . 

• Eaeh Reeeiver d G V uses joint baekward deeoding to deeode souree message mb and eompression 
messages 

Note that the transmitter here simply forwards the feedbaek messages lb_i and ean reconstruet Node fc’s 
inputs for all fc G [2 : A^]. Thus we are able to superpose the transmitter’s inputs on 

the reeeivers’ and relays’ inputs (t^, ... ,x'%), whieh attains eooperation between the transmitter and the 
reeeivers&relays. 

The eoding is explained with the help of Table 
1) Codebook: Fix the pmf 


r N 




■ N 

. fc =2 


Px3\XfPYfi\Xf ■ 


(38) 


For eaeh bloek 6 G [1:5 + 1] and fc G [2 : A^j, randomly and independently generate 2’*^'“ sequenees 
x^fe(/fc,6_i) ~ nr=i^Vfe(Tfc,fe,i), Ik,h-i e [1 : 2”^'“]. For eaeh lk,h-i, randomly and independently generate 
2 '^Rk sequences yl^,{lk,b\lk,h-i) ~ ]Ti=iP%\xSy'^fi,i\xk,h,i)- For eaeh lb_i, randomly and independently 
generate 2”^ sequences T^;,(m;,|lb_i) ~ nr=i Pxi\xfi.xi^bAx 2 ,b,i, ■ ■ ■,XN,b,i), G [1 : 2"-^^]. 
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TABLE II 

Coding scheme 1A for multicast network with eeedback 


Block 

1 

2 

B 

B + 1 


®i_i(mi|l[jv-ii) 

a;r,2(tTi2|li) 


2:r,B+i(l|ls) 

A;, 

<i(l) 

2 ( 4 , 1 ) 

■ ■ ■ ^k,B (^A;,S — 1 ) 

^k,B+ldk,B) 

n 

yfe,i(^fe,i 1) 

yfc.2(4,2|4,i) 

yfe,B(4,s|4,s-i) 

ilk,B + 1 (1|4,b) 

Yd 

mi 

(?Tl2,il) 

t— (m B, is i) 

Is 


2) Source encoding: In each block 6 G [1 : 5 + 1], assume that the transmitter already knows l;,_i 
through feedback pipes. It sends 

To ensure that source node perfectly knows we have 

Rk < Rvh,k- (39) 


3) Relay and receiver encoding: Relays and receivers both use compress-forward. In each block b G 
[1:5], node A: G [2 : iV] compresses by finding a unique index such that 

Then, it sends through the feedback pipe at rate 

Rk < -Rpb.fcj for k E [2 : iV]. (40) 


and in block 6 + 1 sends fJ_^_RR^b) ■ 

By the covering lemma [|2^ . this is successful with high probability if 

Rk > I{Yk,Yk\Xk) + 6(e/2), for A; G [2 : N]. 


(41) 


4) Decoding: Receiver d E V performs joint backward decoding. For each block 6 G [5 + 1,..., 1], 
it looks for {7fib,lb-i) such that|^ 

{xlRmb\\b-i),xlRl2,b-i), • • •, x^,bi^N,b-i),ylb, 

y2,bi^2,b\^2,b-l), ■ ■ ■ ,yN,bi^N,b\lN,b-l)) e TJ'iRx^'Yi^Yd)- 

By the independence of the codebooks, the Markov lemma [l23l, packing lemma [|^ and induction on 
backward decoding, this step is successful with high probability if 


R + Rk 

keT 

< /(Xi, X(r); F(n, Y,\X{r^)) + H{Yk\Xk) 

keT 

- H{Y{T)\X^,Y{r‘^),Y,) - 6{e) (42) 


for all r C [2 : iV; 


Combining (39 
Theorem [TJ 


n with n 5 7 ^ 0. 

42) and using Fourier-Motzkin elimination [|23l to eliminate R 2 , ■ ■ ■, Rn, we obtain 


^Receiver d £ V knows ld,b-i since it generated this index. Since each Receiver d makes its own estimate of mb and L-i, the precise 
notation is i[_\). For simplicity, we omit the superscript (d). 

^Each receiver knows the compression message it generated, and it doesn’t need to decode all compression indices , ljv,6_i), 

we therefore have T C [2 : TV], rather than T C [2 : A"]. 
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B. Scheme IB 

In Scheme lA above, the relays and receivers use only compress-forward. In this subsection we present 
a scheme where the relays perform mixed compress-forward and partial decode-forward. 

Define 


Ifo {hfi-, • • •, lN,b) 

Ifo := {hfi-, • • •, lN,b) 

for 6 G [1 : i? -I- 1] and let Iq = l[Ar-i]- 

Transmission takes place in i? -f 1 blocks each consisting of n transmissions, where a sequence of B 
i.i.d message m;, G [1 : 2”^], 6 G [1 : 5] is sent over B + 1 blocks. Split the message m?, into 
where m'^ and m'l are independently and uniformly distributed over the sets [1 : 2^^'] and [1 : 2”^ ], 
respectively, where R\ R" > 0 and so that 


R = R' + R". 


(43) 


Let = 1. In each block 6 G [1 : i? -f 1]: 

• After obtaining all feedback message lb_i, the transmitter sends inputs lb_i); 

• Each Relay r e 71 first uses partial decode-forward to decode part of the source message, i.e., m[, and 

then uses compress-forward to compress its observed outputs ylb- Finally, it feeds the compression 
index R^b back to the transmitter through the feedback pipe and broadcasts lr,b-i) in block 

6 + 1 . ’ 


• Each Receiver d E 77 first uses compress-forward to compress its observed outputs Then it feeds 
the compression index back to the transmitter through the feedback pipe and broadcasts x^Rld,b-i)- 
Finally, it uses joint backward decoding to decode source message m'^') and compression 

messages 

Similar to Scheme lA, the transmitter’s inputs x% are imposed on ft,..., since it can re¬ 
constructs x'^Rm'f^_^Jr,b-i) and x^RR^b-i), which attains cooperation between the transmitter and the 
receivers&relays. 


The coding is explained with the help of Table III 


TABLE III 

Coding scheme IB for multicast network with partial eeedback 


Block 

1 

2 

B 

B + l 

Ai 


Xi, 2 {'m. 2 \m 2 ,m[,h) 

a:r.s(ms|ms,ms_i,ls_i) 

ma,I_B) 

A,. 

<i(l.l) 
«"i(mi|l, 1) 

Xr, 2 {mi,lr,l) 
w"2(ui2 mi, k,l) 

X^B(xnB-ldr,B-l) 
w"s(ms|mB_i, L,s-i) 

®r,S + l(mfl, L,s) 

Ur 

Mr,B+l(l|ms, L,b) 

Yr 

+"i(+i|l,l) 

y"2dr,2\mi,lr,l) 


yr,fl + l(l|mB, U,b) 

Xd 

®S,i(l) 

Xd, 2 dd,l) 

x 2 .B{ld,B-l) 

Xd^B + ldd,B) 

Yd 

yhiRiW 

yd.2(L,2 L,l) 

yd.s(L,s|L,s-i) 

Vd.B+l (l|L,s) 

Yd 

rh-i 

(m+mi,ii) 

(ms.m's-iJiJ-i) 

(ms,is) 


1) Codebook: Fix pmf 




XrUrPYr\UrXrYr 


.ren 


id£V 


XdPyalXaYa 


^ Pxi \X^U(Tl) TpAI xN. 


(44) 


For each r E 71 and block 6 G [1:5 + 1], randomly and independently generate sequences 

<ft(r«ft_L ^r,b-i) ~ nr=i Pxr{xr,b,i)’ wi* m'ft.^ G [l : 2^^'] and Rb-i e [1 : For each (rn'ft.^^, Rb-i), 
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randomly and independently generate 2”^' sequenees ~ YYi=iPur\Xriur,b,i\xr,b,i)- For 

eaeh (m'f,, randomly and independently generate 2 ”^’’ sequenees ~ 

nj=l ^r,b,i)- 

For eaeh d G V and bloek 6 G [1 : -B + 1], randomly and independently generate 2”^^^* sequenees 

x\fXld,b-i) ~ ]Ti=iPxA^d,b,i), ld,b-i e [1 : For eaeh ld,b-i, randomly and independently generate 

2 nRd sequenees yd^^,{ld,bVd,b-i) ~ ]Ti=iPYa\Xii.yd,bAxd,b,i)- 

For eaeh (m'f,, rn[_^, randomly and independently generate 2^^" sequenees lfe_i) ~ 

ni=l Pxi\U{TVjX^ ^2,b,i^ ■ ■ ■ ■> XN,b,i)- 

2) Source encoding: In eaeh bloek b E [1 : i? + 1], assume that the transmitter already knows l;,_i 

through the feedbaek pipes. It sends |m'^, l 6 _i). 

To ensure that the transmitter perfeetly knows we have 

Rk < -RFb.fe, for G [2 : N]. (45) 

3) Relay encoding: Relay nodes perform the mixed eompress-forward and deeode-forward. For eaeh 
bloek 6 G [1 : S + 1], assume that Relay r G TZ already knows rh'h-i from bloek 6 — 1. It looks for a 
unique index m'f, sueh that 

e T^/i{PXrYrUr)- 

then it eompresses by finding a unique index sueh that 

yr,bi^r,b\P^byR^b-ly^r,b-l),yr,b) ^ "^ 72 )• 

Then, it sends Ir^ through the feedbaek pipe at rate Rr < i?Fb,r and in bloek 6 + 1 sends Ir^). 

By the eovering and paeking lemmas, this is sueeessful with high probability if for r ElZ, 

R' < I {Ur] Yr\Xr) - 6(e/4) (46a) 

Rr > I{Yr] Yr\Xr, Ur) + 6(e/2). (46b) 


4) Receiver encoding: Reeeiver d eV eompresses y^j, by finding a unique index h sueh that 

{^d,bi^d,b-l),yd,bi^d,b\ld,b-l),yd,b) ^ '^f^U^Rx^YaYd)' 

Then, it sends ld,b through the feedbaek pipe at rate 

Rd < .Rpb.d 


and in bloek 6 + 1 sends 


i^d,b)- 


By the eovering lemma, this is sueeessful with high probability if 

Rd>I{Yd]Yd\Xd) + 6 {e/ 2 ). 


( 47 ) 


''since each Relay r£TZ makes its own estimate of mj, the precise notation For simplicity, we omit the superscript (r). 
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5) Decoding: Receiver d eT> performs backward decoding. For each block 6 G [5 +1,..., 1], it looks 
for such that|^ 

r,m,rAv),y2_,) e V(Px«umyry.) 

where 

Xb(^) := {xlb{K-iX,b-i) : r e 7^} 

:= -.deV] 

<(^) := ; r G 7^} 

yh{T^) ■= {yT,bXb\^b:^'b-iX,b-i) : r G 7^} 

rb{V) := {rd,bXAkb-i) -.deV}. 

By the independence of the codebooks, the Markov lemma, packing lemma and the induction on 
backward decoding, the decoding is successful with high probability if 

R + R{T U7^) 

< J(Xi, X{r U 7^), F(r" n V), Yd\X{r^ n V)) 

+ y;//(n|f/»,XO+ ^ H(Y,\Xi) 

k&Tl jeVnT 

-H{Y{T U 7^) |Xf, UA, Y{T^ n V), Y,) - 5(e) (48) 

and 


R” + RiT) 

< I{X,,X{T),U{Ty,Y{TA,Y,\X{TA)) 


+ H{Y,\Uk,X,)+ 

k&nrrr jevnT 

-H{Y{T)\XA,UA,Y{rA,YA-d{e) 


(49) 


for all T C [2 : X] with fl P 7^ 0, where T'^ is the complement of T in [2 : X], and Ud = ^, for 
deV. 

Combining (43-49), and using Fourier-Motzkin elimination to eliminate R', R", R 2 , ■ ■ ■, Rn, we obtain 
Theorem [2l 


C. Scheme 1C 

In Scheme IB, all relay nodes decode the same part of the source message, which may lead to low 
achievable rates if some relay’s observed outputs are very bad. In this subsection, we describe another 
scheme (Scheme 1C), which allows different relays to decode different parts of the source message. This 
new scheme can achieve higher rates than Scheme lA and IB. 

Transmission takes place in i? + 1 blocks each consisting of n transmissions, where a sequence of B 
i.i.d message rn;, G [1 : 2”^], 6 G [1 : 5] is sent over B + 1 blocks. Split the message irib into 

XX{K,b ■ r e 'R},m'A). 

^Receiver d € 2? knows ld,b-i since it generated this index. Since each Receiver d makes its own estimate of (m(',the 
precise notation is m^y\,\bA)- For simplicity, we omit the superscript (d). 
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where messages tUq^, and m'l are independently and uniformly distributed over the sets [1 : 

[1 : 2”^^] and [1 : 2"^^"], respeetively, where Rq,R'j,,R'' > 0 and so that 

R = r'^ + J2K + R”- (50) 

tGTZ 


TABLE IV 

Coding scheme 1C for multicast network with eeedback 


Block 

1 

B 

B + 1 

Xi 

|m'i, l[|7j|+i], l[]v-i]) 


^LB+lflllllTJI + lli inB,lB) 

E, 

E,i(l) 

Fo,s(?Tlo,B-l) 

I^0,s(’^0,fl) 

Uo 

Wo.lfTflo.lIl) 

Wo,s(™'0,sl^o,s-i) 

'^0,S+i(’FIo,bI”To,B-i) 

Xr 

<l(l,l|l) 

^r,B{l^r,B-ldr,B-l\mQg_d) 

^r.S + lf’^r.Bi k,B|Blg b) 

Ur 

^r,l (^r,l 1 ^ 0,1 ! 1 ) I5 1) 

ItTIq b, JTIq b-I, lr,B-l) 

^r,S + l(t| t> ^ 0 ,Si ^r.Bj k,B) 

Yr 


yr,s(k,B|f)TQ Bi ^r,Bj ^0,S-l5 ^r,S-li k,B-l) 

yr,B + l(l| li ^r,Bt ^0,Si ^r,B! ^.b) 

Xd 

<l(l) 

®d,B(L,B-l) 

®d,S+l(L,B) 

Yd 

yhiRiW 

yd,s(L,S L,S-l) 

yd,B+l(l|L,B) 

Yd 

mi 

(mB,ih's-i,is-i) 

-s- (ms,iB) 


Define 


< := (m'o: r G 7^}) 
:= {h,b, ■ ■ ■, 

Ife := (yh,b, ■ ■ ■, lN,b) 

riifo = {^o,b, {K,b -r en}) 


for b E [1:5 + 1]. Let 


= K,b+i = K,o = K,o 


= 1 and lo = l[Ar-i]. In eaeh bloek b E [1:5 + 1]: 






After obtaining all feedbaek messages lb_i, the transmitter sends 
Eaeh Relay r eTZ deeodes and generates the eompression message Ir^ by eompressing 

its ehannel outputs y'^^. Then, it forwards Ir^b to the transmitter over the feedbaek pipe and sends the 
ehannel inputs lr,b\'m,Q j,) in bloek 6 + 1. 

Eaeh Reeeiver d E V first eompresses its ehannel outputs then forwards the eompression 

message ld,b through feedbaek pipe and sends the ehannel inputs x'^^^_^^{lr,b) in bloek 6 + 1. Einally, it 


uses joint baekward deeoding to deeode souree message (m‘ 


'h-iixn'l) and eompression messages 

) sinee it ean reeon- 


.X 


Similar to Seheme lA, the transmitter’s inputs are superposed on 
struet for all k E [2 : A^], whieh attains eooperation between the transmitter and the reeeivers&relays. 


2,hi 


rpTl 

1 ■^n,b 


The eoding is explained with the help of Table IV 
1) Codebook: Eix pmfs 


PvoPuq\Vo 


PXr\VoPUr\VoUoXrPYr\VoUoUrXrYr 

.rER. 


X 


WPXdPYa\XiYd 


Pxi\X^U{'R.)- 


(51) 


Eor eaeh bloek 6 G [1 : 5 + 1], randomly and independently generate 2”'^o sequenees Vq ~ 

nr=i^+(^M)’ with e [1 : 2”-^)]. Eor eaeh m'b-i, randomly and independently generate 2"^^o 

sequenees Mo,6(m'o Jm'g ~ nr=i ^Co+o(«oa>o,m)- 
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For each r G 71 and each randomly and independently generate sequences 

Xr,b{'<^r,b-iJr,b-i\mQ f,_-^^) ~ ]J^=i Pxr\Vo{xr,b,i\vo,b,i)’ wlth G [l : 2"-^-] and lr,b-i e [1 : 2"-^-]. For 

o,fe_i,/r,b-i), randomly and independently generate 2*^^^ sequences 


each 


0 , 6 ’ 


m'o lr,b-i) ~ nr=i Pur\VoUoXr.{ur,b,i\vo,b,i, Mo,6,i, Xr,b,i)- For cach (m'o f,, m'o ;,-i, lr,b-i), 

randomly and independently generate 2’^^’" sequences f,, ttIq /r,fe-i) ~ 

ni=l -^yr|VbC/otfr2f,.(^»’.^>>*I^O.^.*’ 'Ur,b,ii Xr,b,i)- 

For each d G V and block 6 G [1 : -B + 1], randomly and independently generate 2”^^ sequences 
x^f,{ld,b-i) ~ ]T ^=1 Pxa{^d,b,i), ld,b-i e [1 : 2'^^‘i]. For each ld,b-i, randomly and independently generate 
2 nRd sequences y^,,{ld,b\ld,b-i) ~ IY^=i PYa\Xa(yd,b,i\^d,b,^)■ 

For each (m^, randomly and independently generate 2^^^'' sequences mj_^, lfe_i) ~ 

ni=l Pxi\VoUoUi'R)X^ {^l,b,i\R0Ah UOAh ^2,b,i, ■ ■ ■ ,XN,b,i, {Ur,b,i ■ r G P}) ■ 

2) Source encoding: In each block 6 G [1 : -B + 1], assume that the transmitter already knows lfe_i 
through the feedback pipes. It sends x'l^{ml\va'^,m!^,_^,\b-i). 

To ensure that the transmitter perfectly knows we have 


Rk < -Bpb.fc, for /c G [2 : N], 


(52) 


3) Relay encoding: Relay nodes perform hybrid compress-forward and decode-forward. For each block 
be [1 ; i? -f 1], assume that Relay r eP already knows from block 6 — 1. It looks for a 

unique index rhg ^ such that 

(<6(^0,6-l)’ <6(^0,fel^0,6-l)’ 

^r,biP^r,b-lJr,b-l\m'o,b-l)) ^ VJsiPvoUoXrYr) ■ 

Then it looks for m(, f, such that 

(^^0,6 (^0,6-1) ’ «0,6(^0,61^0,6-1) ’ 

'Rr,bi'P‘'r,b\'P‘'0,bi R^0,b-li ^r,b-l) 

^ TJ/^{PvoUoXrYrUr) ■ 

After decoding it compresses by finding a unique index l^^b such that 

(^^0,6 (^0,6-1) ’ «0,6(^0,61^0,6-1) ’ 

'Rr,biR^r,b\R^0,b: ''^^0,6-1 ’ ’ R,b-l) 

yr,bikb\m'o,b, ^0,6-1’ 

Xj.b{'rhrfi-ljlr,b-l\'bho^b-l)) ^ Re/2{PvoUoUrX rYrYr)- 

Finally, it sends Ir^ through the feedback pipe at rate 

Rr ^ Bpb^r (53) 

and in block 6 -f 1 it sends Ir^bldi-o b)- 

By the covering and packing lemmas, these are successful with high probability if for r eP, 

R'^ < /(Bo;nm,X,) -<5(e/8) (54a) 

B: < I {Ur-, Yr\Xr, Bq, Bq) - 5(e/4) (54b) 

Rr > I{Yr]Yr\Uo,Xr,Ur,Vo) + 5{e/2) (54c) 
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4) Receiver encoding: Receiver d eV compresses by finding a unique index Idfi such that 

{^d,bi^d,b-l),yd,bi^d,b\ld,b-l),yd,b) ^ ' 

Then, it sends ld,b through the feedback pipe at rate 

Rd < -Rpb.d (55) 


'■'d,h+l{^d,b)- 


and in block 6 + 1 sends 

By the covering lemma, this is successful with high probability if 


Rd > I{Yd, Yd\Xd) + 6(e/2), for deV. 


(56) 


5) Decoding: Receiver d eV performs backward decoding. For each block 6 G [i? +1,..., 1], it looks 
for (m'f(, ift-i) such that|^ 

{xlb{rhl\m^, m;_i, l^.i), x^(7^),x;((T>), 

'*^0,b{R^0,b-l) ^ '^0,b{R^0,b\R^0,b-l) i^b{R) 1 

fbi.'R)^fbiR)yyd,b) ^ X^i^VoUoX^U{n)Y2^Ya) 


where 


x-(7^) 

x^{V) 

<(7^) 


= {Xr,b(K,b-l,kb-l\m'o,b-l) -r en} 

= {^Ibikb-i) --deV} 

= ^0,6-1) ^r,6-1) (r,b-i) : r G 7 ^} 

= {yk(^rkR^0,b,K,b^R^0,l^l,K,l^lJr,l^l) : r G 7^} 


fbiR) ■■= {rd,bikb\kb-i) -.deV}. 

By the independence of the codebooks, the Markov lemma, packing lemma and the induction on 
backward decoding, the decoding is successful with high probability if 

R', 

keT keT nil 

< i{x,,x{r), u{ry, Y{ry, Yd\Vo, Uo, x(r^), u{r^)) 

+ H{Yk\Vo,Uo,Uk,Xk)+ Y1 H{YyXj) 


k&TZnT 


j&vnT 


and 


-H{Y{T)\Vo, Uo, XkU,kY{r^), Yd) - 6(e) 
R + ^ ^ Rk 

keTvjTl 

</(V^,[/o,Xl,X(ru7^),f/(7^); 

Y{r^nv),Yd\x{r^nv)) 
+ Y.H{%\Vo,Uo,Uk,Xk)+ Y. 


(57) 


ken 


jevnr 

-AT ttN 


-H{Y{T U n)\Vo, Uo, xy, Ui\Y{T^ n V),Yd) - 6(e) 


(58) 


^Receiver d £ T) knows ld,b-i since it generated this index. Since each Receiver d makes its own estimate of (m^,m+j, the 

precise notation is i(_\). For simplicity, we omit the superscript (d). 
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for all T C [2 : A^] with nV ^ 0, where is the eomplement of T in [2 : N], and Ud = ^, for 
deV. 

Combining (50-58), and using Fourier-Motzkin elimination to eliminate R 2 , ■ ■ ■ ,Rn,R'' and R'^, for 
r eTZ, we obtain Theorem 


VII. Discrete Memoryless Multicast Network 


In Seetion VI we proposed bloek-Markov eoding sehemes for DM-MN with instantaneous, rate-limited 
and noisy-free feedbaek. Reeall the NNC seheme 0, |I81, BUl for DM-MN without feedbaek, where eaeh 
node (ineluding the transmitter) eompresses its observed signals and sends the eorresponding eompression 
message in the next bloek. Comparing our eoding sehemes with NNC, we observe that both sehemes 
involve bloek-Markov eoding, eompressing ehannel outputs and sending eompression messages. However, 
our seheme allows hybrid relaying strategies at relay nodes, and in eaeh bloek, instead of ereating a new 
eompression index, the transmitter forwards all eompression indiees generated by the reeeivers and relays. 
In our seheme, the transmitter and the relays&reeeivers eooperate with eaeh other through feedbaek, and 
different nodes operate differently aeeording to the features of the network, whieh leads to a larger 
aehievable rate than NNC, as shown by examples in Seetion |Vj 

Motivated by our feedbaek eoding seheme, we propose another seheme for DM-MN without feedbaek. 
The key idea is that in eaeh bloek, instead of obtaining the eompression messages through feedbaek 
pipes, the transmitter deeodes them based on its observed ehannel outputs. One must be eautious that 
when in absenee of feedbaek, the transmitter’s inputs eannot be superposed on the reeeivers’ and 
relays’ inputs ■ ■ ■, x'% b) like the feedbaek ease. This is beeause, in eaeh bloek b. Node k ereates 
eompression message lk,h by eompressing eompressing and sends Xkfi+i{--ih,b) in bloek 6-1-1. The 
transmitter has to wait to observe the ehannel outputs Vi^+i and then deeodes lk,b, whieh means that at 
the beginning of eaeh bloek b, the transmitter ean only reeonstruet before the transmission. 

To ensure the eooperation between the transmitter and the reeeivers&relays, we made the following 
modifieation: Transmission takes plaee in B + 2 bloeks eaeh eonsisting of n transmissions. In eaeh bloek 
b, eaeh Node k G [2 : N] ereates a eompression index lk,b-i and sends {lk,b-iJk,b- 2 )- The transmitter, 
after observing first deeodes eompression indiees whieh is in essenee a eoding problem on a 
multiple aeeess ehannel Pyi\X 2 ,...,Xn "'bh side information Then in bloek 6-1-1, the transmitter sends 
eompression messages lfe_i with souree message rrib+i. The eoding is explained with the help of |V| 


table V 

Coding scheme eor multicast network without feedback 


Block 

I 

B 

B + 1 

B + 2 

Xi 

XiRm'i\mi, 1,1) 

Tl. S (iTls 1 m's , , lfl_2 ) 

Y\^B+\(t\l, Is-i) 

Xl,B+2{t\t, 1,1s) 

Vr 

^r,l (I 7 1 ) 


K,B+l{fn'Bdr,B-l) 

'^” 3 + 2 ( 1 , ^r,s) 

Xr 

<i(l|l,l) 


^r,B-\-l {J‘r,B \ q , lr,B—l ) 

®r,S+2(l|l, C,s) 

Ur 

1 , 1 ) 

u" b llU-S-l > tr,B-2) 

+ U,B-l) 

w"b+2(1|1, lr,B) 

Yr 

1, 1, 1) 

15 "^Bi ^r,B—2, lr,B—l) 

yr,B + l{l\'rn'B, 1, lr,B-l, lr,B) 

2/"s+2(1| 1, 1, tr,B, 1) 

Vi 

<i(l) 

Vd,B{bl,B-2) 

'>’d,B + ldd,B-l) 

'v'd.B+2{td,B) 

Xi 


Xi^Bdd,B-l\ld,B-2) 


®d,B+2(lKii,s) 

Yi 

riARAVt) 

yd,B{l-d,B\ld,B-2,ld,B-l) 

yd,B + imid,B-l,ld,B) 

yd,B+2(l|^d,B, 1) 

Yi 

m!{ 

<r- [fh'B , ih'B-l I i-B-2 ) 

<— (ma,iB-i) 

is 
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1 ) Codebook: Fix the pmf 


■ N 



n PVkPXk\VkPUk\Vk 


WPYr\UrVrXrYr 

_k=2 


.r&Tl 


X 


WPYa\VaXdYi 

.d&V 


Pxr \VfU{'R.) Py^ I Xf • 


( 59 ) 


For block 6 G [1 : B], split the message rrib G [1 : 2 "^^] into where and m'l are independently 

and uniformly distributed over the sets G [1 : 2 "^^'] and [1 : 2 "^^ ], respectively, where R',R" > 0 and so 
that 


R = R' + R". 


( 60 ) 


Let 1_1 = lo = l[Ar-i] and = "^5+2 = 1 - 

For each r ElZ and block 6 G [1 ; -B + 2 ], randomly and independently generate sequences 

Vr^i,{m[_^,lr,b-2) ~ ]Ti=iPvr{vr,b,i), with G [1 : 2 ^^'] and lr,b-2 e [1 : 2 ^^^]. For each (m'^.i,/^,b_2), 
randomly and independently generate 2 ”'^’’ sequences x'!^bi^r,b-i\'m'b_i,lr,b-2) ~ nr=i PXr\Vr{Xr,b,i\'^r,b,i)- 
For each pair (m'^_^,/r,fe-2), randomly and independently generate 2 "^^' sequences u'^lr,b-2) ~ 
YY^=iPur\Vr{ur,b,i\vr,b,i)- For cach {mb,m'b_i,lr,b-2,lr,b-i), randomly and independently generate 2 ”-^’' 

sequences /j.^f,_ 2 ,/r, 6 —1) ~ Y\i=lPYr\UrXrVr^y^t^d\^rtb,ii^r,b,iiVr,b,i)- 

For each d G V and block 6 G [1 : -B + 2 ], randomly and independently generate 2 ”^^* sequences 
Vd,bi^'d,b-2) ~ IY!^=1 Pvaivd,b,i), with ld^b-2 ^ [1 : For each ld,b-2, randomly and independently 

generate 2 '^^'^ sequences x]^,^{ld,b-i\ld,b-2) ~ U^=iPxa\vA^d,b,i\vd,b,i)- For each {ld,b-2,ld,b-i), randomly 
and independently generate 2 ^^-^ sequences ylbikb\ld,b-2,ld,b-i) ~ IlkiPYa\Xavky<i>b,ik<i^b,hVd,b,i)- 
For each (m(, m'b_i, h-2), randomly and independently generate 2 ”^" sequences m'b_i-, lfe-2) " 

ni=l Pxi\U{'R)V^k^,b,i\'^2,b,ii ■ ■ ■ Tl^N,b,ii ^ P}}' 

Let 


vr(7^):=K,(mU,/;,_2):rG7^} 

<iP) ■■= {vlbikb-2) -.deV} 

xf(7^) := {x'^i,{ir,b-i\mb_iJr,b-2) : r G 7^} 

xi^{V) := {xlb{ld,b-i\kb-2) :deV} 

K(P) ■= {K,bi^'b\m'b-Y kb-2) : r G 7^} 
f'biP) ■= {yk(kb\'dblmki,kb- 2 ,kb-i) ; r G 7^} 
yr(P) := {ra,bikb\kb- 2 ,kb-i) :deV}. 

2 ) Source encoding: At each block & G [1 ; -B + 1 ], after observing y'^^, it looks for lb_i such that 


{xlb{m^l\ml mkJb-2),ynP)ybiP)XkP), 
xr(P).<■ (K),<,) <=-T:),(Pv«x«u»y,) 

where m'l = ml, and since the transmitter knows the source message it sent. 

After finding compression indices in block 6 + 1 the transmitter sends x^^j^^{m'lj^^\m'^j^^, m(, lb_i). 
By the packing lemma, this step is successful with high probability if for all subset J C [2 : A^], 

R{J) < I{X{J); Y,\X{J^), Vf, B(7^),Xi) - 5(e/8). 


( 61 ) 
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3) Relay encoding: Relay nodes perform mixed eompress-forward and partial deeode-forward. In each 
block 6 G [1 : -B + IL assume Relay r ElZ already knows from previous block. It looks for a unique 
index m'f, such thatH 

{Vr,bi^b—li ^r,b—2)t Xj. ij{lr,b—1 Idlh—ii lr,b—2)i 

K,bi^'b\'>^'b-lJr,b-2),yr,b) ^ ’TJ/eiPXrYrUrVr)^ 

then it compresses by finding a unique index lr,b such that 

(..n „.n n n 

\^r,bi ^r,bi '^r,bi Urfii 

yr,bi^r,b\'dli„rhij_i,lr,b-2-,lr,b-l)) £ '^e/i{PvrUrXrYrYr)' 

Then, in block 6 + 1 it sends ^r,b-i)- 

By the covering and packing lemma, this step is successful with high probability if for r ElZ, 

B! < I {Ur] Yr\Vr, X,) - 5(e/6) (62a) 

Rr > I{Yr]Yr\Vr,Xr,Ur) + 6{e/4:). (62b) 


4) Receiver encoding: Receiver d eV compresses by finding a unique index ld,b such that 


{v2,bi^d,b-2),Xdfi{id,b-l\ld,b-2), 

yd,bi^d,b\id,b-2,id,b-l),yd,b) ^ / i^^VdX yY^Yd)' 

Then, in block 6 + 1 it sends x^^_^^{ldfi\h,b-i)- 

By the covering and packing lemmas, this step is successful with high probability if 

Rd > I {Yd] Yd\Vd, Xd) + 5(e/4), for deV. (63) 


5) Decoding: Receiver d G V performs backward decoding. For each block 6 G [B + 2, 
for (m'f(,m'j_^,lfc_2) such thatj^ 


«,(m"|m'„ m'_i, U), vr (7^), vr (iP), xr (7^), xr (P), 
n',-{n),yT{n)ST{'D),ylb) e V{Pv-xmn)Y-Y)- 


., 1], it looks 


By the independence of the codebooks, the Markov lemma, packing lemma and induction on backward 
decoding, the decoding is successful with high probability if 


R + R{T U7^) 

< i{Xi, v{T u n),u{n),x{T u n)]Y{r^ n v)Xd\ 

V{T^),X{T^ nv)) 

RY.H{%\Xu,Uk,Vu)+ Y. H{Y,\X,,V^) 

fce7^ jevnT 

-H{Y{T U n)\Vf, Xf , Y{T^ n V), Yd) - 6{e) 

(64) 


^Since each Relay r £TZ makes its own estimate of m(, the precise notation should be For simplicity, we omit the superscript (r). 

^Receiver d £ 2? knows ld,b -2 since it generated itself. Since each Receiver d £ makes its own estimate of (m(', li,_ 2 ), the precise 

notation is i 6 J 2 )- For simplicity, we omit the superscript (d). 
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and 


R” + R{r) 

< I{X,y{T),U{T),X{Ty,Y{T^),Yci\ 

v{r^),x{r^),u{r^)) 

+ HiYk\Xk,Uk,Vk)+ 

keTZnT jevnT 

-H{Y{r)\V,^,Xy^,Ui^,Y{r^),Y,)-6{e) (65) 


for all r C [2 : iV 


Combining (60 
Theorem HI 


with T'^ rTD 7 ^ 0 and Ud = 0, for all d eV. 


651, and using Fourier-Motzkin elimination to eliminate R', R", R2 , ■ ■ ■, Rn, we obtain 


VIII. CONCLUSION 
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